Edit Models filters

Inference Providers

Misc

GGUF

Inference Endpoints

4-bit precision

8-bit precision

Merge

text-generation-inference

text-embeddings-inference

Models

6,299

Full-text search

Active filters: GGUF

MaziyarPanahi/SciPhi-Self-RAG-Mistral-7B-32k-Mistral-7B-Instruct-v0.2-slerp-GGUF

Text Generation • Updated Jan 26, 2024 • 61 • 3

LiteLLMs/Hermes-2-Pro-Llama-3-8B-GGUF

Updated May 6, 2024 • 45 • 1

helizac/TURNA_GGUF

Text2Text Generation • Updated Jun 13, 2024 • 203 • 3

legraphista/shieldgemma-9b-IMat-GGUF

Text Generation • Updated Aug 5, 2024 • 212 • 1

MaziyarPanahi/Yi-Coder-1.5B-Chat-GGUF

Text Generation • Updated Sep 4, 2024 • 224k • 10

tensorblock/gte-Qwen2-7B-instruct-GGUF

tensorblock/Llama-3-ELYZA-JP-8B-GGUF

Updated Apr 20 • 115 • 1

tensorblock/gemma-2-9b-it-DPO-GGUF

Updated Apr 20 • 81 • 1

tensorblock/Blue-Orchid-2x7b-GGUF

Updated Apr 21 • 273 • 1

Goekdeniz-Guelmez/Josiefied-Qwen2.5-Coder-14B-Instruct-abliterated-v1

Text Generation • Updated Feb 23 • 13 • 2

MaziyarPanahi/Mistral-Small-24B-Instruct-2501-GGUF

Text Generation • Updated Jan 30 • 274k • 5

MaziyarPanahi/Slush-ChatWaifu-Chronos-GGUF

Text Generation • Updated Feb 10 • 35 • 1

tensorblock/DeepHermes-3-Llama-3-8B-Preview-GGUF

Updated Apr 21 • 91 • 1

kalle07/embedder_collection

tensorblock/Mistral-Small-24B-Instruct-2501-abliterated-GGUF

Updated Apr 21 • 231 • 2

MaziyarPanahi/gemma-3-12b-it-GGUF

Text Generation • Updated Mar 12 • 242k • 10

MaziyarPanahi/gemma-3-27b-it-GGUF

Text Generation • Updated Mar 16 • 227k • 5

DavidAU/Reka-Flash-3-21B-Reasoning-Uncensored-MAX-NEO-Imatrix-GGUF

Text Generation • Updated Mar 21 • 14.6k • 49

tensorblock/DeepHermes-3-Llama-3-3B-Preview-GGUF

Updated Apr 21 • 67 • 1

MaziyarPanahi/ReasonFlux-F1-14B-GGUF

Text Generation • Updated Mar 24 • 25 • 1

tensorblock/all-hands_openhands-lm-32b-v0.1-GGUF

Text Generation • Updated Apr 23 • 132 • 1

tensorblock/RWKV_v6-Finch-14B-HF-GGUF

Updated Apr 29 • 192 • 1

tensorblock/SmerkyG_rwkv-6-world-3b-GGUF

Updated Apr 30 • 217 • 1

kroonen/OpenOrca-Platypus2-13B-GGUF

Updated Aug 30, 2023 • 4 • 2

Mozilla/llava-v1.5-7b-llamafile

Updated Apr 1 • 6.99k • 183

Trelis/openchat_3.5-function-calling-v3

Text Generation • Updated Mar 6, 2024 • 20